EXTENDING THE DEFINITION OF ENTROPY 
TO NONEQUILIBRIUM STEADY STATES. 

by David Ruelle* 

Abstract. We study the nonequilibrium statistical mechanics of a finite classical system 
subjected to nongradient forces £ and maintained at fixed kinetic energy (Hoover-Evans 
isokinetic thermostat). We assume that the microscopic dynamics is sufficiently chaotic 
(Gallavotti-Cohen chaotic hypothesis) and that there is a natural nonequilibrium steady 
state p£ . When £ is replaced by^+S^ one can compute the change Sp of p^ (linear response ) 
and define an entropy change 5S based on energy considerations. When £ is varied around 
a loop, the total change of S need not vanish: outside of equilibrium the entropy has 
curvature. But at equilibrium (i.e. if £ is a gradient) we show that the curvature is zero, 
and that the entropy S(£ + 5£) near equilibrium is well defined to second order in 5£. 

Introduction. 

The purpose of the present paper is to discuss the statistical mechanics of a finite 
physical system maintained in a nonequilibrium steady state at a constant temperature. 
In such a system, entropy is produced at some constant rate > 0. Here we investigate the 
possibility of also associating a finite entropy S with our nonequilibrium system, extending 
the definition of equilibrium entropy. We restrict our discussion to the case of a classical 
system with an isokinetic thermostat (as defined by W. Hoover [9] and D. Evans [6], see 
below) . 

If p(dx) = g(x)dx is the probability measure in phase space corresponding to an 
equilibrium state, the corresponding Gibbs entropy is 



S(p) = -J dxg(x) logg(x) 



The probability measure p(dx) describing a nonequilibrium steady state is in general sin- 
gular with respect to dx, and the corresponding Gibbs entropy is thus — oo. To extend 
the definition of entropy outside of equilibrium we shall use another idea, based on the 
thermodynamic relation 5S = 5Q/T, where 5Q is energy exchanged, and T the absolute 
temperature. 

We consider a finite mechanical system in a nonequilibrium (in general) steady state 
p^ under the effect of a nongradient (in general) force £ and an isokinetic thermostat at 
temperature f3 . We give below a definition of the entropy increment — > £ + 8£) 
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corresponding to a small increment 8£, of £. Our definition is based on energy exchanged, 
uses the microscopic dynamics of the system, and agrees with the equilibrium statistical 
mechanics definition when £ and 5^ are gradient forces, i.e., for equilibrium situations. 
Outside of equilibrium, for a loop the sum S'(loop) of the entropy increments 

in not expected to vanish in general. This means that the "entropy connection" has a 
curvature. Since 5" (loop) is of second order in the size of the loop, the increment S(£ — > 
£ + 5£) is well defined to first order in <5£. If £ is a gradient the curvature vanishes and 
therefore the entropy close to equilibrium 



is well defined to second order in 5£. 

Systems outside of equilibrium exhibit a variety of phenomena, like metastability and 
hysteresis, which we want to exclude here. We assume that a nonequilibrium steady state 
is naturally defined, and we study its variations under parameter changes by using the 
techniques of the ergodic theory of differentiable dynamical systems. Basically we assume 
that the microscopic dynamics is sufficiently chaotic (this is the content of the "chaotic 
hypothesis" of G. Gallavotti and E. Cohen [8]). Our nonequilibrium steady state is 
then a natural or SRB measure and we apply linear response theory (D. Ruelle [13]) to 
determine changes of for variations £ — > £ + The linear response is given by integrals 
over time which generalize those appearing in the fluctuation-dissipation theorem. 

Mathematical proofs of the linear response formulas are within reach under suitable 
assumptions of uniform hyperbolicity. (A hyperbolic system with singularities and isoki- 
netic thermostat close to equilibrium has been rigorously studied in [2]). But, in general, 
uniform hyperbolicity assumptions are unrealistically strong from a physical point of view. 
The present paper is thus meant as theoretical physics rather than mathematical physics. 
There is a leap of faith in believing that our linear response formulas apply to any given 
physical setup, but the situation is not worse than for applications of the fluctuation- 
dissipation theorem. 

In [14] another approach to the definition of entropy outside of equilibrium was pro- 
posed (Lyapunov entropy) replacing phase space volume by volume in a suitable (Kaplan- 
Yorke) reduced dimension. This idea was taken up in [7] where an attempt is made at 
defining the entropy in the large system limit. We do not investigate here this limit. Phys- 
ically, the entropy is best defined in the large system limit as the Boltzmann entropy, a 
concept based on the phase space volume associated with a given macrostate, and vigor- 
ously defended by J. Lebowitz [11]. It remains to be verified if the definition of entropy 
given in the present paper can be related to the Boltzmann entropy. One would also like 
to check that our results are not tied to the use of the isokinetic thermostat, but extend 
to more general situations. (The isokinetic thermostat is very convenient for calculations, 
but does not quite reproduce the Hamiltonian time evolution at equilibrium). 

Isokinetic time evolution. 

We consider the classical time evolution 




(1) 
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where p, q G ~R N . We shall also use the notation x = ^ J e R 2Ar and rewrite (1) as 
The Euclidean scalar product of vectors a, 6 in 

r tv Qr R 27V wiU be denoted by a • b. The 
force £ = £(<?) is not necessarily a gradient, and we take 

/ x P'f(?) 

a = a(x) = 

p-p 

so that 

*(^)=0 

The term — ap in (1) corresponds to the much discussed isokinetic thermostat (a special 
case of the Gaussian thermostat of Hoover and Evans, see [9], [6], [10]). We shall denote 
by (/|)teR the flow defined by (2), i.e. fix is the solution at time t corresponding to the 
initial condition x. 

Entropy changes. 

The local rate e^(x) of volume contraction corresponding to the vector field is minus 
its divergence, and easily computed to be <&(x) = (N — l)a(x). This is identified with the 
local rate of entropy production (see [1], [3]). When integrated over a nonequilibrium 
steady state p^(dx), it gives the corresponding global rate of entropy production. It is 
natural to define the change of entropy S(£ — > £ + 6£) to be the entropy released in the 
time interval [0, +oo) when the force £ + 5£ acting during the interval (— oo, 0) is replaced 
by £ in the interval [0, +oo). At time t > our system is in a state + 8 t p which reduces 
to P£+5£ at t = and tends to p^ when t — > oo (an expression for Stp will be given below). 
We have thus to first order in 5£ 

S(^Z + SO = J^dtJ 5 t p(dx) e c (x) (3) 

Dynamical assumptions. 

In order to proceed we need now to make some assumptions on the dynamics defined 
by (1) and on the measure p^. As we have said, we want the time evolution to be suffi- 
ciently chaotic, i.e., the flow (/|) to be hyperbolic in some mathematical sense, and the 
nonequilibrium steady state p^ to be an SRB measure. For our purposes we can define 
an SRB measure as a limit lim^ +00 (/|)*(T where a is absolutely continuous with respect 
to dpdq conditioned to {(p, q) : p • p/2m = K}. An SRB measure is usually singular, but 
"smooth along unstable directions" . For a physical discussion of the present setup see [14] . 
We shall also assume exponential decay of correlations (see [4], [5], [12]). As a consequence 
of these assumptions we have the following linear response formula (see [13]): 



M0)=T drp t {V x ^ofl^).5 T F{x)) (I) 

J — oo 
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where S t F is a time dependent small perturbation of the right-hand side of (2), and S t p is 
the corresponding perturbation of p^ at time t. The integral over r converges exponentially. 
The test function <p is assumed to be differentiable because Stp is in general a distribution 
rather than a measure. We have written p^{(j>) = f p^(dx)(/)(x) and similarly for dp. Note 
that for time independent SF the time independent dp is given by 



/oo /> 
ds J ps(dx)V x (ct>ofl).8F(x) 



Notation. 

We have defined 



F*(s)=(* p/ ° p ) , a = a{x) = P -^ , e^(x) = $>(x) = (AT — l)a(x) (5) 

We shall use infinitesimal perturbations 5£ = £\ 5F = F l (no time dependence, i = 1,2) 
and let 

e ~o^ G=(°] 



o ; ' \i) ' uv ( 6 ) 

a i = p.£i/p.p ? = (AT" - 

We also denote by AT the kinetic energy (conserved by (1)), and let f3~ l be the correspond- 
ing temperature: 

2m 2AT 
We shall from now on write /| = /* and = p. 
Proposition. 

With the above notation let 

poo poo p 

id?) = / ds dt p(dx) V x (d> o /*+*) ■ F x (x) (7) 
define a linear form in £}. Then, to first order in I; 1 , 

5(e-e+e 1 ) = 7^e 1 ) (8) 

Using (3), (5), (4), (6) we have indeed 

poo f poo pO 

£ + £*) = / dt / S t p(dxMx)= / dt / drpCV^^o F x (x)) 

JO J JO J-oo 

and replacing t by s, r by — t gives (8). 
Curvature. 
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To second order in we have 

where T)^.^ 1 ) is the functional derivative of 7£(£ 1 ) with respect to £. And an easy second 
order calculation gives 

where the curvature form i?g is defined by 

If C is a closed curve in the space of force fields £, the change of entropy corresponding 
to turning around the curve is § c l£,{d£,)- It is of second order in the size of the curve if 
i?£ ^ 0, of higher order if the curvature vanishes. 

Proposition. 

Define a bilinear form in £ , £ 2 by 



ldi\i 2 )= ds dt p(dx)V x (^ 1 of s + t ).F\x) 
Jo Jo J 



(10) 



Assume now that £ is locally gradient and write G = ( ~ 1 . Then 



^7^e 1 ) = 7^(e,e 1 ) 

(iij 7 £(£,£ 1 ) = -Pf™d8fp(dx)G(rz) ■ {T x f')F\x) 



/•oo />oo /• 

= -/3 / ds dt p(dx) [V x (* ls o /*) ■ F 2 (x) + V x (* 2s o /*) ■ F 1 (x)] 
Jo Jo J 



where V is (x) = G(f s x) ■ (T^F^x). 

(iv) (D av (.,e))(e)=i v (e,e) 

(v) If £ is locally gradient, then 

^(e 1 ,e 2 ) = 7^(e 1 ,e 2 )-7^e 2 ,e 1 ) 

(i) follows directly from the definitions (7) and (10). 
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The assuption that £ is locally gradient means that we have a configuration space 
D C which is not simply connected and that £(q) = — V q V where V is a "multivalued 

function" on D. Writing f*x = ^ , & = (N — l)p ■ l/p • p we have 

f*00 at -i /*00 7 

/ dt * o /'+* = m — / <ft - + f) • £(q(s + t)) 
Jo P'P Jo dt 



(3 lim [l/(g( S ))-l/(g( S + T))] 

J -^oo 



hence 



7^(C,e 1 ) = /5 lim / cfe /p(rfx)[V x t>(Q( S ))-V :i; y(Q( S + T))]-F 1 (x) 

= 131^^ dsJp(dx)V x V(q(s))-F 1 (x)=/3^ ds J p(dx)(^ v ^y(T x f s )F 1 (x) 

= -Pj^ds J p(dx)G(f s x) ■ (T x f s )F\x) 



which proves (ii). 
We have thus 



ldl^) = -Pj Q ds J p(dx)V ls (x) 

^ ls (x) = G(f s x) ■ {T x f s )F\x) = -V x V(q(s)) ■ F l {x) 
Therefore, since p and f s both depend on £, 

-DtMit i )){e) = Dt\pJ~ds J p(dx)v is (x)](e)=i+n 

/•CO i>00 r 

I = (3 ds[ dt p(dx) V x (tf ls o /*) ■ F 2 (x)] 
Jo Jo J 

II=-P J™ ds I p(dx)V x (D^V(q(s))(e))-F 1 (x) 

= (3 \ ds p(dx)V x (G(f s x) • / dtiT^r-^F^fx)) ■ F\x) 
Jo J Jo 

rOO />S r 

= /3 ds dt p(dx) V^ 2 ^ o ft) ■ F\x) 
Jo Jo J 

/>oo poo /> 

= 13 ds dt p(dx) V x (* 2s o /*) ■ F\x) 
Jo Jo J 

where we have renamed s the variable s — t in the last line. This proves (iii). 
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(iv) follows from (10). 

(v) follows from (9), (iii) and (iv), where we take £ = r\ = £. 
The gradient case. 

The situation where £ is a global gradient, i.e., there is a potential function V = V(q) 
such that £(q) = — V q V is called equilibrium in the present context. Let then 

H{x) = K^)e~™ 

The divergence of HF^ is 

V, • (HF e ) = h'{ P -V)e-^)V- ■ - ap) + H[V P ■ (-ap) - (3V q V ■ *-\ 

ZiTYl TYl 7Tl> 

p ■ p m 

which vanishes if h(p ■ p/2m) — 8(p ■ p/2m — K) and (3 = (N — 1)/2K. Therefore the 
probability measure 

p(dx) = Z- 1 5(^-K)e- /3v( - q ' ) dpdq (11) 

(with normalizing factor Z~ x ) is invariant under (/*) (see [6]) and is the SRB measure p 
in the present case. 

Note that, using (11) and integrating by parts, we obtain 

J p{dx) V x cj> • F\x) = Z- 1 J dx V x cj> -S(^£- K)e-P y ^ (? 

= Z~ 1 J dxcf>(x)5( P ^-K)e-^\-V x -(^ l ~ alp ^) = J p{dx)j>{x)&{x) (12) 
Define 

Q{V) = J e-W^dq 
Then the (configurational) Gibbs entropy associated with p is 

r e -PV{q) e -f3V(q) 

S(v) = -j iq WT log w = " (m + ]oeQ(v) 

If V 1 is a small perturbation of V we find to first order in V 1 

s(y + v 1 ) - s(v) = -wvnrxpv 1 )) - K^K^ 1 )] (is) 

Using (8), (i) and (ii) of the above Proposition, and (12) we obtain 

S(£ - £ + e 1 ) =pj™dsj p(dx)V x V(q(s)) ■ F\x) 



= -P ds / p(dx)V(q(s))(N - 1) 



p-p 

o 



= -/3 2 lim f ds f p(dx)V(q)V q{s) V 

T^ooJ_ T J 



i _ dq(s) 
ds 



= -/3 2 lim / pWy^^^-^^-T)^-/? 2 ^^ 1 )-^^)^^ 1 )] 

Therefore the standard estimate (13) from equilibrium statistical mechanics agrees with 
the "nonequilibrium" prediction based on (8). 

Proposition. 

Assume that £ is a global gradient, then 

(i) 7e(^ £ 2 ) = Jo°° ds Jo°° dt I P( dx ) ( $1 ° / S+t )* 2 (^) 

(u)Rs(e,e) = o 



From (10) and (12), (i) directly follows. We use now the involution / : 



:M7 

under which is odd, time is reversed, and p is invariant ("microscopic reversibility"). 
Thus 

7?(e 2 ^ 1 )=/ da dt p(dx)^(x)^(f s+t x) 
Jo Jo J 

poo poo p 

= ds dt p(dx)^ 1 (f- s - t x)^ 2 (x) 
Jo Jo J 

POO POO P 

= ds dt p(dx)^ 1 (f s+t Ix)^> 2 (Ix) 
Jo Jo J 

POO POO p 

= ds dt p(dx)<s>\r +t x)&(x)= 1 z(e,e) 

Jo Jo J 

and therefore = by (v) of the previous proposition, proving (ii). 

Second order formula. 

From the above considerations it follows that if £ is a gradient (£ = — VV), the 
entropy at temperature can be written consistently to second order with respect to a 
(nongradient) perturbation £ x of £ as 

s{z + e) = s(o + id?) + liDaxem 1 ) W 

where is the equilibrium entropy for £, and 

^ 1 )=Pj o °°ds J p(dx)V(q(s))^(x) 



^(Daxeme) =pj o <*» y o J P (d X ) [^(r+y^or) - ^ /^V)] 

with \l/ ls = — V x F(q , (s)) and other notation explained earlier. We have not studied 

S(£ + C 1 ) from the point of view of convexity. 

Conclusion. 

In the present paper we have considered a classical system with isokinetic time evo- 
lution defined by (1) corresponding to a time independent force £ and temperature . 
For such a system we have defined an entropy increment S(£ — > £ + <5£) corresponding 
to an increment 5^ of the force (see (7), (8)). Our definition agrees with the equilibrium 
statistical mechanics formula (for the Gibbs entropy) if £, 5£ are gradient forces. If £ is a 
gradient, but not necessarily 5£, we can write 



where is the equilibrium entropy and S(£ 
order in 5£. 
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